Unmanned Aircraft Systems (UAS) Integration 
in the National Airspace System (NAS) Project 
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Te Introduction 


¢ UAS in the NAS Project Objectives 
— Address technical and safety barriers to the expansion and integration of 
Unmanned Aircraft Systems (UAS) into the National Airspace System (NAS) 
— Produce research findings that guide the development of RTCA Special 
Committee 228’s Minimum Operational Performance Standards (MOPS) for 
UAS 


¢ Identify minimum DAA display information/guidance elements that result in 
acceptable pilot performance and response times 


¢ Detect-and-Avoid (DAA) 

— Existing regulations for manned flight operations require onboard pilots to 
“see and avoid” other aircraft in order to remain well clear (14CFR, Sec 91.113) 

— Unmanned operations will require a traffic display equipped with a “detect 
and avoid” system that provides the information necessary for remaining DAA 
well clear (DWC) 
¢ Detect potential threat(s) > Determine response > Execute resolution 

— UAS traffic displays with advanced conflict resolution tools have reduced DWC 
violations and have been rated favorably by pilots (sell et al., 2012; Draper et al. (2014) 


DAA System: Multi-Level Alerting Structure 


Time to Loss of Aural Alert 
DAA Well Clear Verbiage 


Pilot Action 


Immediate action required 
Notify ATC as soon as practicable 
after taking action 


DAA Warning 
Alert 


“Traffic, 
Maneuver Now” 


On current course, corrective action 
Corrective DAA required 
Alert Coordinate with ATC to determine an 
appropriate maneuver 


“Traffic, Avoid” 


On current course, corrective action 
Preventive DAA should not be required “Traffic, 
Alert Monitor for potential increase in Monitor” 
threat level 


None (Target) No action expected 


Background 


¢ Suggestive DAA displays with maneuver guidance bands have 
improved pilot performance compared to informative displays 
* Quicker response times (Fern et al., 2015; Rorie & Fern, 2015) 
¢ Fewer DWC violations (santiago & Mueller, 2015) 
¢ Depicts predicted safety level of nearby heading/altitude options: 


——<—<_— No-Fly Bands 


¢ Conflict regions: Yellow ¢ Conflict regions: Yellow or Red 
— No indication of severity — Based on predicted threat level 
¢ Conflict-free regions: No bands ¢ Conflict-free regions: Green 


Background 


¢ Suggestive DAA guidance was identified as a minimum display 
requirement in the DAA MOPS, and shall provide: 

— Threat severity of trajectory options predicted to result in loss of DWC 
¢ Bands distinguish caution-level (yellow) vs. warning-level (red) 

— Positive maneuver guidance to recover from a DWC violation once it is 
unavoidable 
¢ Regain DWC function 
¢ Conflict bands remain saturated 


* Open Issues 
— Are conflict-free bands necessary? 
— DWC Recovery guidance concept 


e Direct assessment 
— MOPS compliant 


¢ Examine whether the presence or absence of green conflict- 
free DAA bands impact pilots’ ability to maintain DWC 
— Response time (RT) 
— Loss of DWC (LoDWC) rate 


¢ Evaluate two ‘well clear recovery’ design concepts that aid in 
regaining DWC 
— ‘Limited Suggestive’ vs. ‘Directional’ 
— Does well clear recovery display type impact response times, LoDWC 
severity, or compliance rates? 
— Which recovery guidance design is more preferred? 


Experimental Design 


¢ Conflict-free DAA Bands (between-subjects) 
— Green: conflict-free trajectory options depicted by green bands 
— No Green (None): conflict-free trajectory options are left blank 


Experimental Design 


¢ Well Clear Recovery guidance display option (within-subjects) 
— Generated maneuver recommendation for a timely regain of DWC 
¢ Appeared once DAA guidance became saturated with red bands 


— Limited Suggestive: displayed a green wedge with a suggestion range of 
optimal headings or altitudes to fly in order to maximize separation 


— Directional: displayed a green arrow indicating the general direction of the 


recommended horizontal or vertical maneuver 


Limited Suggestive 


° Participants 
— 6 active-duty UAS pilots 
* Hage = 36 years old 


¢ 1,400 hours of unmanned flight experience 
¢ 1,600 hours of manned flight experience 
— 4commercial pilots 
* Hage = 30 years old 
¢ 9,000 hours of manned flight experience 


¢ Simulation Environment 


— Vigilant Spirit Control Station (VSCS) 
¢ Developed by Air Force Research Laboratory (Feitshans et al., 2008) 
¢ Primary field of view was Tactical Situation Display (TSD): 
— Command-and-control interface 
— DAA guidance & traffic 
— Mission route 


¢ DAA Pilot Task 


— Operate simulated MQ-9 through Class E airspace under Instrument 
Flight Rules 


— Maintain DWC with surrounding aircraft 
¢ Regain DWC when necessary 


¢ Four 40-minute scenarios 


— 16 encounters scripted to lose DWC without pilot action 


¢ 8 blunders that forced an immediate loss of DWC at first alert 
— Triggered onset of well clear recovery guidance 
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¢ Measured Response 
— Primary response time metric is Total Response Time 


¢ Comprised of Initial Response Time and Total Edit Time 


a chidacinaiannidamuvesceames Total puenyueneecoueceatiaeae: 


Response Time 


Onset of Pilot Notifies | ATC Approval Pilot Pilot Sends 
DAA Alert ATC Initiates Edit First DAA 
Upload 
A A 
b eissek: Danian De as Total Edit 


Response Time Time 


Pilot Interaction Timeline 


Tap 


Pilot Sends 
Final DAA 
Uploads 


11 


° LODWC Severity 


— Defined by ‘DAA Well Clear Penetration Integral’ metric (DWCPI) 


¢ Combined amount of time spent within DWC threshold and geometric 
separation at CPA into single measure 


¢ Higher value = more severe 


— Reported by recovery display type 
¢ Only 1 DWC violation across all non-blunder encounters 


¢ Well clear recovery compliance rate 


a= .05 
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Mean (s) 
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¢ Initial RT 


— Initial RTs were, on average, 
1.47s quicker with No Green 


Bands display (p < .001) 


Initial RT 


i 4.57 


6.04 


GREEN NO GREEN 
Banding Depiction 


¢ Total Edit 


— Pilots with green DAA bands 
completed their edits 0.865 
quicker (p = .054) 


Total Edit 


4.73 


S107 


GREEN NO GREEN 
Banding Depiction 
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¢ Total RT 
— Banding depiction did not significantly affect Total RTs (MD = 0.61s) 


Total RT 
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Banding Depiction 
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dance Type 


¢e Measured Response 
— Initial RT 
¢ No significant difference found by display type (MD = 0.37s) 
— Total Edit 
¢ No significant difference found by display type (MD = 0.51s) 
— Total RT 
¢ No significant difference found by display type (MD = 0.14s) 


¢ Compliance Rate 
— Pilots complied with recovery guidance 98% of the time 
¢ Equal compliance rate between displays 
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° LODWC Severity 
— DWC violations were slightly less severe with the Limited Suggestive display 


¢ Difference was nonsignificant (high variability) 


DWCPI (mean) 


LoDWC Severity 


1.38 


1.06 


Limited Suggestive Directional 
Recovery Type 
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for Remaining DWC 


¢ Suggestive DAA Banding Guidance remains effective at 
supporting the primary DAA task, regardless of whether conflict- 
free bands are present 
— Maintained DWC at a nearly equal rate with each display 
¢ Performance comparable to previous analyses 


¢ Implementation of green conflict-free bands is considered 
optional in DAA MOPS 


-e for Regaining DWC 


¢ No significant impact of recovery type on pilot performance, 
preference or compliance 
— Response times were nearly identical 
¢ Recovery guidance calls for immediate action 
¢ Minimal decision-making required 
— Limited Suggestive preferred by 60% of pilots 
¢ Presented a more specific solution range 


¢ Slightly less time spent within DWC threshold compared to Directional 
¢ Referenced as a viable recovery design in DAA MOPS 


¢ Multiple viable guidance options for DWC maintenance/recovery 


THANK YOU! 


kevin.j.monk@nasa.gov 


